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Abstract 

Random transformations are typically good at "scrambling" information. Specifically in the quantum setting, 
scrambling usually refers to the process of mapping most initial pure product states under a unitary transformation 
to states which are macroscopically entangled, in the sense of being close to completely mixed on most subsystems 
containing a fraction fn of all n particles for some constant /. While the term scrambling is used in the context 
of the black hole information paradox, scrambling is related to problems involving decoupling in general, and to 
the question of how large isolated many-body systems reach local thermal equilibrium under their own unitary 
dynamics. 

Here, we study the speed at which various notions of scrambling/ decoupling occur in a simplified but natural 
model of random two-particle interactions: random quantum circuits. For a circuit representing the dynamics 
generated by a local Hamiltonian, the depth of the circuit corresponds to time. Thus, we consider the depth of 
these circuits and we are typically interested in what can be done in a depth that is sublinear or even logarithmic 
in the size of the system. We resolve an outstanding conjecture raised in the context of the black hole information 
paradox with respect to the depth at which a typical quantum circuit generates an entanglement assisted encoding 
against the erasure channel. In addition, we prove that typical quantum circuits of poly(logn) depth satisfy a 
stronger notion of scrambling and can be used to encode an qubits into n qubits so that up to fin errors can be 
corrected, for some constants a, fi > 0. 



1 Introduction 



Random quantum circuits of polynomial size are meant to be efficient implementations that inherent many 
useful properties of "uniformly" chosen unitary transformations which are typically very inefficient. A lot of 
work was done in analyzing convergence properties of the distribution defined by random qua ntum circuits 
to the Haar measure on the full unitary group acting on n qubits llEWS+031 IELL05I IODP071 IZni08l IOH091 
IHL09I iLowlOl iBVlOl 1BHH12 1. Here, instead of trying to study the convergence of these circuits to some limit, 
we study the information-theoretic property of interest directly. This property can be intuitively pictured as 
"scrambling" or spreading some structured or localized information over the global system of n qubits. The 
term scrambling is used in the context of the black hole information paradox [HP07, SS08, LS H+llI , but such a 
property can also be understood in terms of decoupling, a central notion in the study of quantum communication 
BHOW051 IHOW06I IHHYW08I |DuplO| IADHW09I IDBWR10I . On a more technical level, a typical property of a 
scrambler can be seen when we decompose the input and output states in the Pauli basis (which can be seen as a 
Fourier basis): a scrambler tends to reduce the mass of the low-weight Pauli operators. In fact, all of our arguments 
prove a statement of that form. 



1.1 Strong scrambling, quantum error correction and decoupling 

An important example of a scrambler is an encoding circuit for a quantum error correcting code. In particular a k- 
qubit, distance d, non-degenerate error correcting code maps all initial states localized on k qubits to states which 
are completely mixed on all subsystems of size less than d, which can be considered a strong form of scrambling 
when the distance is a constant fraction of n. Another way of defining a good quantum error correcting code is 
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that it decouples a purification of the encoded qubits from any subsystems of size smaller than d. Proving coding 
theorems by proving a decoupling statement has been quite successful culminating in a very general decoupling 
theorem IIHOW051 IHOW061 IHHYW081 [DupTu] IADHW091 IDBWRlOl . Our objective can also be seen as trying to 
determine how fast decoupling occurs. 

We prove the following results: 

• We give a random quantum circuit model of depth 0(log 3 n) that satisfies a strong notion of scrambling. That 
is, for any initial state, on average over the circuit, all subsystems of size at most fn are close to completely 
mixed. 

• This result can also be considered as giving decoupling unitaries that are more efficient than standard 
(approximate) two-designs. Relying on the fact that random quantum circuits are approximate two-designs 
|HL09], it was shown by |SDTR11J that random circuits of size 0(n 2 ) are decouplers in a quite general 
setting. Here we prove that in some particular cases, we can obtain much faster decoupling with circuits of 
depth O (log 3 n). 

• As another application, we prove the existence of stabilizer codes with an encoding circuit of depth 0(log 3 n) 
that have a constant encoding rate and a minimum distance that grows linearly with n. 

It would be interesting to prove that scrambling occurs in depth O(logn) instead. Our second set of results 
proves a weaker notion of scrambling in depth 0(log n). This notion of scrambling is particularly relevant in the 
study of the black hole information paradox question. 

1.2 Black holes and the fast scrambling conjecture 

It was noted in |Pag93], that by collecting the Hawking radiation from a black hole, an arbitrary message dropped 
into the black hole could be recovered after half the black hole had evaporated if the dynamics of the black hole 
could be approximated as a random unitary transformation. This approach was tightened significantly in |HP07|, 
where it was shown that at any time after the black hole has evaporated past its half way point, an m-qubit 
quantum state that was dropped into the black hole could be recovered with high fidelity from an amount of 
Hawking radiation containing slightly more than m qubits of quantum information, as long as the dynamics of 
the black hole approximates a unitary two-design sufficiently. A random quantum circuit model analyzed in 
|DCEL09| was invoked which could, for the purposes of recovering an initial state of constant size, scramble 
the degrees of freedom by a local circuit of depth O(logn). This random quantum circuit model, though highly 
contrived, could be performed by two-qubit gates between nearest neighbours on a 2-dimensional lattice, in 
a depth of 0(y/n\ogn). This amount of time is just enough to avoid a violation of the quantum no cloning 
principle assuming complementarity at the event horizon. This motivated interest in the scrambling properties 
of more natural models of random quantum circuits that may better represent a naturally arising Hamiltonian. 
It was conjectured in |SS08] that this was possible in time Ofo 1 ^) and O(logn) for a local Hamiltonian in d- 
dimensions and infinite dimensions respectively, with fc-body interactions. Since the signaling bound precludes 
faster scrambling, such unitary transformations are referred to as "fast scramblers". 

• Here we resolve the fast scrambling conjecture for random quantum circuits in the case of constant message 
size. We show that typical random quantum circuits on <i-dimensional lattices and the complete graph, 
of depth 0(n 1/ '' 1 log 2 n) and O(logn) respectively, scramble a message of constant size m such that it may 
be recovered with high fidelity using only m + c randomly selected qubits, for some constant c. Since a 
straightforward lower bound of ^(n 1 ^) and fi(log n) can be shown, our results are nearly optimal. 

1.3 Proof technique 

The first step of the proof is to relate the property of interest, which is most naturally stated in terms of the trace- 
norm, to the two norm, whose behavior under under the random quantum circuit can be completely described 
by its second-order moment operator. For the random quantum circuits we consider, this moment operator, when 
evaluated in the Pauli basis, can be seen as a Markov chain on the set of Pauli basis elements (also called Pauli 
strings). This means that the properties of interest can be seen as properties of this Markov chain. 

Most previous studies of random quantum circuits bounded the convergence using the spectral gap of the 
moment operators. However, as we show, the spectral gap only weakly depends on the underlying interaction 
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graph of the circuit. This means that any result that uses the spectral gap of the second moment operator will give 
bounds on the scrambling time that would also apply to circuits where the gates are applied between neighbouring 
cells on a one dimensional line. In particular, as the diameter of the interaction graph plays a crucial role in 
determining the scrambling speed, it is necessary in our proofs to go beyond placing bounds on the spectral gap 
and to make use directly of the Markov chain (or a Markov chain obtained from lumping certain states), which 
heavily depends on the interaction graph. 



2 Preliminaries 
2.1 Generalities 

The state of a pure quantum system is represented by a unit vector in a Hilbert space. Quantum systems are 
denoted A, B, C . . . and are identified with their corresponding Hilbert spaces. The Hilbert spaces we consider 
here will be mostly n-qubits spaces of the form (C 2 )®". To describe a distribution {pi, . . . ,p r } over quantum states 
{|^>i), • ■ ■ , (also called a mixed state), we use a density operator p = Si=iPil^i)(V , i|/ where IV'XV'I refers to 
the projector on the line defined by A density operator is a Hermitian positive semidefinite operator with unit 

def 

trace. The density operator associated with a pure state is abbreviated by omitting the ket and bra ip = \ip){ip\. 
S(A) is the set of density operators acting on A. The Hilbert space on which a density operator p E S(A) acts is 
sometimes denoted by a subscript, as in p&. This notation is also used for pure states \iP)a <= A. 

In order to describe the joint state of a system AB, we use the tensor product Hilbert space A <g) B, which is 
sometimes simply denoted AB. If pab describes the joint state on AB, the state on the system A is described by 

def 

the partial trace pa — trg pab- If t/ is a unitary acting on A, and \ip) a state in A ® B, we sometimes use U\ip) to 
denote the state (U ® t B )\i/j), where the symbol 1b is reserved for the identity map on B. For an introduction to 
quantum information, we refer the reader to INCOOl. 

Throughout the paper, we use the Pauli basis, which is an orthogonal basis for 2x2 matrices: 

ff0 = 1 CTl = ( 1 ) ° 2 = ( i 7 ) CT3 = ( -1 ) • 

For a string v e {0, 1, 2, 3}", we define a v = a Vl ® • • • ® a Vn . The support supp(^) of v is simply the subset 
{i e [n] : z/j 7^ 0} and the weight w(v) = |supp(z/)|. 

We now introduce some various notation. The notation poly (rt) refers to a term that could be chosen to be any 
polynomial and the power of the polynomial can be made larger by appropriately choosing the related constants. 
As we are going to deal with binomial coefficients, the binary entropy function h(x) = — x log x — (1 — x) log(l — x) 

def 

is going to be used. We also use the shorthand [n] = {1, . . . , n}. 



2.2 Random quantum circuits 

We consider two related models for random quantum circuits. In a sequential random quantum circuit a random 
two-qubit gate is applied to a randomly chosen pair of qubits in each time step. For a general interaction graph, 
instead of choosing a pair at random from all the possible pairs, we choose a random edge in the graph. Here the 
random two-qubit gate is going to be a random Clifford gate or a gate uniformly chosen from the Haar measure 
on the unitary group acting on two qubits. In fact, as the second-order moment operator is the same for these 



two models, our results apply equally well to them. However, the result of Theorem 3.6 proving the existence of 
stabilizer codes with efficient encoding makes explicit use of the model with random Clifford gate. Since we are 
interested in the speed at which scrambling occurs rather than the gate complexity, we ask into how many layers 
of gates can the sequence be decomposed so that no two gates act on the same qubit. To construct the parallelized 
circuit, one keeps adding gates to the current level until there is a gate that shares a qubit with a previously added 
gate in that level, in which case you create a new level and continue. We show that parallelizing a size n random 
circuit results in a depth of 0(log n) with high probability. 

In order to avoid this overhead, we also consider a circuit model which is parallelized by construction. In this 
second model, a random maximum matching of on the complete graph is chosen and a random two-qubit gate is 
applied to qubits that are joined by an edge. We will also be interested in partially parallelized construction when 
in each time step a random edge is drawn from each of a set of coarse grained cells on a rf-dimensional lattice. 
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A model of random circuits of a certain size defines a measure over unitary transformations on n qubits that 
we call p c ; lc . We will sometimes compare the behaviour of the circuit to a unitary transformation chosen from the 
Haar measure phaar over the full unitary group on n qubits. 

As mentioned earlier, the second-order moment operator will play an important role in all our proofs. The 
second-order moment operator is a super-operator acting on two copies of the space of operators acting on the 
ambient Hilbert space, which is an n-qubit space in our setting. For a measure p over the unitary group, we can 
define the second moment operator M as 

M[X <g) Y] = B {UXU^ <g) UYU^} . 

In particular M haar = E {UXW ® UYW\. Any distribution for which M = M haar is referred to as a two- 
design. We will be using the following properties of the second moment operator. 

• For a circuit composed of t gates chosen independently, the second moment operator is M c i lc = M* where M 
is the second-order moment operator corresponding to the measure obtained when applying one gate. 

• For all the measures p we consider here, the second moment operator is Hermitian. In addition, all 
eigenvalues of the moment operator are bounded in absolute value by 1 and for the measures we consider, 1 
is the only eigenvalue of magnitude 1. 

• The eigenspace V for the eigenvalue 1 can be shown to be the space of operators X acting on 2n qubits such 
that for all unitary transformations UXW <g> W = X (for the distributions p we consider here). It follows 
that this space is the span of the identity operator and the swap operator. The moment operator of the Haar 
measure, Mh aar , is the projector onto V. 

These properties imply that if M is the second-order moment operator associated to the random quantum 
circuits we consider here, M 4 converges to Aihaar as t — > oo at an asymptotic rate determined by the second largest 
A2 (in absolute value) eigenvalue of M. The gap of the moment operator is defined by A = 1 — A2, and the larger 
the gap, the faster the moment operator converges to Mhaar- In order to study random quantum circuits when the 
interaction graph is a <i-dimensional lattice, we wil l need a lower bound on the gap of these random quantum 



circuits. In order to obtain that, we proceed as in |Zni08, BHH12] seeing the second -order moment operator as 



a local Hamiltonian. In fact, for a sequential random quantum circuit, we can write the second-order moment 
operator as follows: 

i<j 

where m,, = E (UXW (g> UYW\ and p is the normalized measure over gates that act only on qubits i and 

j and qij is the total probability over such gates. Then, one can use a result on the gap of local frustration free 
Hamiltonians | Nac96 1 . The property of being frustration free in this context simply mean that if X is invariant for 
M c i rc , then it is also invariant for the terms my, which follows easily from the properties mentioned above. 

As mentioned earlier, the Pauli basis will play an important role in our analysis. Consider a representation 
of the moment operator M in the basis defined by a v <Ei a^, with v,fi£ {0,1,2,3}". This defines a matrix 
{Q ((/i, n'), [v, v')) of size 16" x 16". 

First, it can be shown that for the random quantum circuits we consider here, we have 

Q(( f M,fj,'),(v,u')) = ^- E {^[{a^a^iUa^ ®Ua^)]} = 0, 

4 U~p 
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unless v = v' and \i = fjf. As a result, we will simply write v). Note that for any a, we have 



^£{0,1,2,3}™ 



^JE {K[{a v ®a u ){Ua^ ®Ua^)]} 

^G{0,1,2,3}™ ~ P 

(ue{0, 1,2,3}" J 

^>[(t/^) 2 ]} 



2"- l/~p 

1 

1. 



trk 2 J 



This proves that {Q(/i, can be seen as the transition matrix of a Markov chain on the set of Pauli strings 

{0, 1, 2, 3}™. This Markov chain is going to play an important role throughout the paper and the information 
theoretic properties we are interested in are going to be expressed in terms of its properties. More precisely we are 
going to consider the chain obtained by removing the state 0" (which is isolated from the rest of the chain). 

Given a set of interacting pairs, to which Haar random (or Clifford) two-qubit gates are applied, the Markov 
chain for the sequential random quantum circuit is constructed in the following way. Consider only gates acting 
on qubits i and j. If the Pauli string is (T g) cr on i and j, then there are no transitions induced as the gate acts as 
the identity on the string. If the value of the string is a a <g> <Jb with (a, b) ^ (0, 0) on qubits i and j, then following 
from invariance of the Haar measure under unitary transformations, the value of the string on i and j transitions 
to each a c (g> ad where (c, d) is chosen uniformly from {0, 1, 2, 3} 2 — {(0, 0)}. An average over all such transition for 
each interacting pair allowed by the interaction graph results in the Markov chain for this circuit. 



3 Strong scrambling, decoupling and quantum error correction 

In this section, we prove that a random circuit of size 0(n log 2 n) scrambles (on average over the choice of circuit) 
any initial state in the sense that all subsets of size at most fn for some constant / are very close to maximally 
mixed. In order to prove such a result, we consider the total mass of the coefficients corresponding to the 
Pauli strings of weight at most fn, and prove that it is small with very high probability. The common thing 
between proving strong scrambling and obtaining error correcting codes with large minimum distance is that the 
probability bounds should be close to optimal. More precisely, we prove that a Pauli string of weight £ is mapped 
by the random circuit to a Pauli string of weight at least fn with probability at least roughly 1 — m . The following 

, then says that this circuit can with high probability be parallelized so that it has depth 0(log 3 n). In the 



3.2 



Section 

following sections, we see how we can interpret our upper bounds on the total mass on low-weight Pauli strings 
to prove results on decoupling and quantum error correcting codes for low-depth random quantum circuits. 



3.1 Sequential random circuit 



Theorem 3.1. Let p(0) be an initial arbitrary mixed state on n qubits and p(t) be the corresponding state after the application 
oft random two-qubit gates (the sequential circuit model). Then provided f is such that / log 3 + h(f) — -^J^ < and 
t > cn log 2 n (for some large enough constant c), we have for all subsets S of size at most fn, 

1 1 



E{tr[p s (;) 2 ]} 



< 



2\ s \ 2l s lpoly(n) : 
where the expectation is taken over the random circuit. This implies that 

2 ~1 



E 



Ps(t) 



1 

2~isi 



< 



1 

poly(rc) ' 



(1) 



(2) 
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Proof First, observe that |TJ easily implies |2| using the Cauchy-Schwarz inequality: 



Ps(t) 



2\ s \ 



<2 \s\ 



- n\S\ 



Ps(t) 



2\ s \ 



ti[p s (t) 2 }-2 



tr[p s (t)} , tr[l] 



2l s l 



2 2 \ s \ 



= 2^ t r [ Ps (t) 2 } - 1. 
To compute tr[p s (t) 2 ], we decompose ps(t) in the Pauli basis: 

PS® = 2 2_|S ' tr[<r„p(i)K. 

we{0,l,2,3} s 



As a result, we have 



i^e{0,l,2,3} s 

- E 

^e{0,l,2,3} s 

1 



tr[q,p s ft)] 2 
2l s l 

tr[<7„ ® l S c tr S c[p(^)]] 2 
2l«l 



E 

ive{0,l,2,3} s ,i^0 

1 v tr^pft)] 2 

- 2l s l ^ 2l s l 



21-51 



Our objective now is to study the evolution of the quantity E {j2v-.i<w(v)<\s\ t r [°V P(*)] 2 j as a function of i. As 
we described in the preliminaries, applying a random two-qubit gate has a simple effect on the decomposition 
into the Pauli basis: an identity on two qubits always gets mapped to an identity and a non-identity Pauli string 
on two qubits gets mapped to a uniformly chosen non-identity Pauli string (of which there are 15). 

Our focus will be to study the Markov chain that describes the evolution of the distribution of the weight of 
the different levels Y^ V :w{u)=k E {t r [°V/°(*)] 2 }- More precisely, we can write for any k € {1, . . . , n}, 

E{tr[<r„p(t)] 2 } = ]T E{tr[a M p(t-l)] 2 }E{tr[^[/ t ^[//] 2 } 
= P(k-i,k) E{tr[^p(t-l)] 2 } 

fi:w(fi)—k—l 

+ P(k,k) £ E{tr[<7 M p(i-l)] 2 } 

+ P(k + l,k) E{tr[<7 M p(i-l)] 2 }, 



where the matrix P 6 



is defined by 



P(x,y) 



1 - 



2x(3n— 2g-l) 

5n(n — 1) 
2x(x-l) 

bx{n — x) 
5n(n—l) 

o 



if y = x 
i£y = x — 1 
if y — x + 1 
otherwise. 



We refer the reader to | HL09 1 for more details on how to derive the parameters of this Markov chain. In fact, 
[HL09 J study the mixing time of this Markov chain. Here, we need to analyze a slightly different property: starting 
at some point I, what is the probability that after t steps the random walk ends up in a point < fn? One can obtain 
bounds on this probability using the mixing time but these bounds only give something useful for our setting if 
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t = Q(n 2 ). So we will need to improve the analysis of | HL09 ] and go directly for computing the desired probability 
instead of going through the mixing time. More precisely by defining the Markov chain {X s (£)} s >q that starts at 
I and has transition probabilities given by P, we have 

fn n 

E E E{trKp(i)] 2 }=E E tr[^p(0)] 2 P{X t W</n}. (3) 

k— 1 u:w{u) — k £—1 i/:w(i/)—£ 

If the initial state p(0) is a pure product state, then one can verify that 

71 

.1 



E tr^p(0)] 2 =(^). 



In general, we have 



E trKp(0)] 2 < E 2 |S| tr[p s (0) 2 ] 

v:w(v)=l S:\S\=i 



< 2 l 



The main technical result in this proof is in Theorem A.l (which we defer to the appendix), where we obtain a 
bound on P {X t (£) < fn)} < + 2 ^(^) poi y (») ' Plu §§ in § this into we obtain 

E E E{tr[^)] 2 }<E E Eltr^O)] 2 }. + E E Ejtr^O)] 2 } 

k = lv:w(v)=k t=lu:w(v)=t \n/2)° i=\ u:w(v)=k 



< 



tl W ^G)poly(n) L/ 2 )3"/ 2 
1 



poly(n) ' 



provided / is such that / log 3 + h(f) - ^ < 0. □ 



3.2 Parallelizing the circuit 

Recall that we are interested in the depth of random circuits. A priori, the circuit studied in the previous section 
has a depth that is as large as the number of gates which is nearly linear. But in general in such a circuit there are 
many successive gates that are applied on disjoint qubits so they could be actually performed in parallel. More 
precisely, we look at the gates one by one in the order they are applied. For the purpose of this section, the gates 
can simply be labelled by the two qubits the gate acts upon. To construct the parallelized circuit, one keeps adding 
gates to the current level until there is a gate that shares a qubit with a previously added gate in that level, in which 
case you create a new level and continue. In the following proposition, we prove that by parallelizing a random 
circuit on n qubits having t gates we obtain with high probability a circuit of depth O ( - log n). 

Proposition 3.2. Consider a random sequential circuit composed oft gates where t is a polynomial in n. Then parallelize the 
circuit as described above. Except with probability 1 / poly(n), you end up with a circuit of depth at most O (- log n) . 

In order to prove this lemma, we use the following calculation: 

Lemma 3.3. Let G\, . . . ,Gk be a sequence of independent and random gates Gi € (™), then the probability that G\, . . . , Gk 
form a circuit of depth k is at most ( ^) k 1 • k\ 

Proof We prove this by induction on k. For k = 2, we may assume G\ = (1, 2), in which case P {G 2 fl {1,2} 7^ 0} < 
4/n. Now the probability that G\, . . . , Gk+i form a circuit of depth k + 1 can be bounded by 

P {Gi, . . . , G k form a circuit of depth k } ■ P {G k+1 n {G x U • U G k ) ^ 0|G X , . . . , G k form a circuit of depth k } . 
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Now it suffices to see that, conditioned on [G\, . . . ,Gk form a circuit of depth k], the number of nodes occupied by 
G\, . . . , Gk is at most k + 1. Thus, using this fact and the induction hypothesis, we obtain a bound of 



fc-i 



kl-2- 



k + 1 



(fe + 1)! 



□ 



which conclude the proof. 
Proof [of Proposition |3.2| Suppose we apply m gates for some m to be chosen later. 

P {Gi, . . . , G m form a circuit of depth at least d } = P {3(ii, . . . , id) € [m] d : G^ , • • • , Gi d form a circuit of depth d} 



< 



d-l 



■d\ 



< m d ■ 



d-l 



Now we can fix m = n/4 and <i = c log n + 1 for some constant c to be chosen depending on the desired probability 
bound, then we have 



P {Gi , . . . , G m form a circuit of depth at least d } < 



2m 

n 



d-l 



< n 



This proves that every set of n/4 gates generate a circuit of depth at most c log n + 1 with probability at least 
1 — l/n~ c+1 , and so if we have 4t/n such sets, we get depth at most 4t/n(c\ogn + 1) with probability at least 
\-At/n c . ' □ 



The next corollary follows directly from Theorem 3.1 and Proposition |3.2| 

Corollary 3.4. In the parallelized random quantum circuit model with depth 0(log 3 n), we have 

2"! 



E 



Psit) 



t 



< 



1 



poly(n) 



(4) 



for all subsets S of size at most fn with f such that f log 3 + h(f) — < 0. 



3.3 Decoupling and quantum error correcting codes 

Scrambling is related to the notion of decoupling. The idea of decoupling plays an important role in quantum 
information theory and many coding theorems amount to proving a decoupling theorem |HOW05 HOW06 

IHHYW08llADHW09l[DupTu]lDBWRl'0ll. 



Consider the setting described in Figure]!] Let \$)mm' an d \^)aa' be pure states on MM' and A A' respectively. 
Then apply some unitary transformation to the system M'A' (which for us is going to be a random quantum 
circuit) and map it to a system that we call B. Let us denote by \p)bma the output state. Assume now that the 
reduced state pms on M together with some subset S of the qubits of B is a product state: pms = Pm ® Ps 
(the subsystem S is decoupled from the reference M). Then by Uhlmann's theorem (or the unitary equivalence of 
purifications), there exists an isometry acting on AS C that recovers a purification of the system M. If for example 
|$)mm' is a maximally entangled state, then the previous argument shows that if we input quantum information 
into the M' system, it can be recovered from the systems AS C alone with no need for the system S. 

In the following for simplicity, we focus on the case 

i/e{0,l,2,3} m 

where the systems M and M' consist of m qubits. For the AA' system, we will focus on two important cases: First 
where A' is already in a pure state \iP)a' = |0)a'/ so that it can be written in the Pauli basis as 
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s s c 

< > <r 



M 



r 







Random circuit 



A 



Figure 1 : Illustration of decoupling for random quantum circuits 



and second the case where ipAA' is maximally entangled so that 

1 



AA> 



2 2(n- 



E 

i/e{0,l,2,3}"- 



(6) 



which corresponds to entanglement assisted communication. Of course, one could obtain a statement for general 
states and this would depend on the decomposition of the states $mm' and ipAA' in the basis of Pauli strings and 
more precisely on the weight distribution of this decomposition. 

A decoupling statement is very similar in spirit to scrambling and the analysis is almost the same except that 
we use a specific state for the input. Using Theorem A.l which was the main technical ingredient in the proof of 
Theorem 3.1 we can get the following decoupling and coding results. 



Theorem 3.5. In the setting of equation |5), we have if m < f3n and any S of size \S\ < fn with (3 < 1/9 and 
(3 < log 3/2 — / log 3 — h(f), and p is the state obtained after applying parallelized random quantum circuit of depth 
(9(log 3 n), we have 



1 



Pais 



1 



i polyH 



with probability 1 — 1/ poly(n) over the choice of the circuit. 

In the setting of equation |6) (entanglement assisted coding), we have for (3 < 2/3 and j3 < 



l+Iog3/2-/log3-h(/) 
2 ' 



Pms 



1 



i poly(n) 



with probability 1 — 1/ poly(n) over the choice of the circuit. 



Remark. The rates we obtain here are not optimal, but we prove that it is possible to code at constant rate with a 
constant fraction of errors using a circuit of polylogarithmic depth. It would be interesting to determine whether 
it is possible to achieve the capacity of the erasure channel using such shallow circuits. For example, it would be 
interesting to improve the bound in the entanglement assisted case to (3 < 2 ~f lo &3-Hf) This is the bound one 
would get for a random unitary distributed according to the Haar measure on the unitary group acting on n qubits 
and is reminiscent of the entanglement assisted capacity of the depolarizing channel. □ 

Proof We start with the entanglement assisted case, for which the calculation is a bit simpler. We apply a random 
quantum circuit to the system M'A'. We can write the initial state on MM' A' as 



P(0) 



2 2r, 



E 



fG{0,l,2,3} r 



2™- 



We study the evolution of the state p(t) when we apply t random gates, more precisely we study the behaviour of 
the reduced state when a subset size k = (1 — f)n qubits are discarded (from the M'A' system), the objective is to 



9 



show that the remaining state is close to maximally mixed. We have 

ii i 2 

P(t)MS 



E 



< Ejtr^tgfcr^^lp^)] 2 } 
i/G{0, 1.2, 3} m ,^£{0,1,2, 3} s ,(!/,/i)^0 

< E{tr[a,®(J Al/ 9(i)] 2 } 

i/6{0 : l,2,3} m ,i«(M)</n,( l ' ! M)/0 

tr{a u ®a u ® tp{Q)] 2 ~P {X t {w{v)) < fn} 

i/e{0,l,2,3} m ^#0 



E 



3*P{X t (^) <fn}, 



where we used the same notation as in the proof of Theorem 3.1 X t (£) is the random variable denoting the weight 
of the Pauli string obtained after applying t random gates to the operator for some p of weight £. 

If t > cn log 2 n, we can apply Theorem A.l and obtain 

2 /iog3+M/) 



E- 



Pit) 



1 



MS 



< 



poly(n) 



E 

e=i 

m 

E 



(4" 



Vn/2 



)3"/ 2 



m(m — !)••• (m — £ + 1) /3 



P ol y( n ) ^ n(n-l)---(n-^+l) 



- + (4™ - 1) 



2 /log3+ft(/) 

(„%)3" /2 ' 



This means that provided to and / are small enough, most of the random circuits with t = (9(n log 2 n) gates 
are good encoders that allow the (approximate) correction of any fn erasure when entanglement assistance is 
available. In other words, if we write to — (3n, then as long as (3 < 2/3 and 2(3 + f log 3 + h(f) — 1 — log 3/2 < 0, 
the reference system M is decoupled from any subset of at most fn qubits of the output. 

We now move to the case where the state \ip)A' is pure. In this case the initial state on MM' A' can be written as 

1 1 



p(0) = 



2 2 



m On-m 



E 



t>e{o,i,2 : 3} m ,/ie{o,3}' 1 - 



Then, the analysis is the same 
1 2 ' 

E <! p{t) MS ~ 



Y tr[a v ® a^p(0) M >A>} 2 P {X t {w{v) + w(p)) < fn} 

i>e{0,l,2,3} m ,Aie{0,3}' l - m „(^)^0 
n I min(£,m) 

/ m \ i it — i ) i \ \ 

P{X t (e)<fn} (7) 





< 



n I min(^,ro) 

E E 



2 /log3+h(/) 



Pj \t-Pj (2)2*poly(n) 



/2 



(8) 



If to = (3n, the second term vanishes provided (3 + / log 3 + h(f) — log 3/2 < 0. For the first term, we need to 
analyze carefully the number of Pauli strings a v ® with a given weight I which does not have an expression 
that is as simple as in the entanglement assisted case. Our objective is to prove that 



min(£,m) 

E 

p=0 



71 — TO 

e-p 



< £ 



2 f . 



using the fact that rn is not too large, so that we get a vanishing bound on the trace distance. We bound the terms 
for p < £/2 and p > £/2 separately. We have 



e/2 

E 

p=0 



n — to 

e-p 



< 



< 2 l 



; E 

n 



ton in — m 
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For p > k/2, this needs a bit more work. We have 

m(m — !)••■ (to — p + 1) • (n — m)(n — m — 1) • 



n — m 
l-p 



(n — to — (£ — p) — 1) 



p!(*-p)! 

First we have p!(^-p)! > ((^/2)!) 2 > J[. We also have 

m{m — 1) • (m — p + 1) < ( — J n(n — 1) • • • (n — p + 1). 



Moreover, as p < to, we have 

(n — to) ■ 

As a result, for p > ^/2, 



(n — m — + p + 1) < (n — p) ■ ■ ■ (n — p — £ + p + 1). 



n — m 
l-p 



By choosing m/n < 1/9, we can now bound the number of Pauli strings of weight 



min(£,m) 

E 

p=0 



m 
P 



< I? 



Returning to |8}, provided m/n < 1/9 we get 

p{t)us 



E ■ 



1 



< 



E 



poly(n) 



-)7l-\-m 



2 /log3+M/) 
(n/ 2 )3"/ 2 ' 



We can then obtain the claimed results by parallelizing these sequential circuits (Proposition 3.2 1. 



□ 



Another way of interpreting the analysis above is that random quantum circuits define good stabilizer codes, 
i.e., codes with a positive rate and linear distance. Such a result can be seen as a step towards understanding the 
complexity of encoding into good quantum error correcting codes. There are many results on various classical 
versions of this problem; see e.g., ||GHK + 12| for a recent result in this spirit. 

Theorem 3.6 (Good codes from low-depth circuits). There exists non-degenerate stabilizer codes with encoding circuits 
of depth 0(log 3 n) encoding (3n qubits into n qubits and having a minimum distance an for some constants a, /3 > 0. 

Proof 

It is not hard to see that a circuit composed of Clifford gates that maps all Pauli strings of the form a v ® 
with v € {0, 1, 2, 3} m and fj, € {0, 3}"~ m into Pauli strings of weight at least fn defines a stabilizer code encoding 
to qubits and having distance fn. That is exactly what the analysis in the proof of Theorem 3.5 shows. □ 

The results in this section involve random quantum circuits of depth 0(log 3 n). It would be interesting to 
improve these scrambling times to O(logn) instead. Our second set of results presented in the following section 
proves a weaker notion of scrambling in depth 0(log n). This notion of scrambling is particularly relevant in the 
study of the black hole information paradox question. In addition, we also consider this notion of scrambling 
when the interaction graph is a <i-dimensional lattice. 



4 Scrambling and the black hole information paradox 

Here we show that there are natural random quantum circuit models that perform good entanglement assisted 
codes for the erasure channel. Note that this is a weaker notion of scrambling since we require that only a constant 
number of initial low weight Pauli strings are brought to linear weight strings with high probability. In this 
section we will consider a different model of random quantum circuit where gates are selected from among sets of 
matchings between neighbors on lattices of fixed dimension and from the complete graph. For the e?-dimensional 
models, to aid in our proofs we introduce an additional set of coarse grained blocks of size O(logrt) between 
which disallow gates to be performed for coarse time steps of 0(log 2 n). We show that a constant size message for 
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typical random quantum circuits of depth n x l d log 2 n and log n for random quantum circuits with gates that act on 
a bounded number of qubits between neighbors on <i-dimensional lattices and two-qubits gates on the complete 
(infinite dimensional) graph. For quantum circuits consisting of gates of fixed weight a straightforward upper 
bound is given by the radius of the interactions graphs of n x / d and log n, so that our results are essentially optimal. 
Assuming the random quantum circuit models accurately capture the scaling behavior of typical Hamiltonians 
with the same interaction graph, as argued in |HP07| these time scales determine the time at which a quantum 
state which falls into a black hole sometime after half the black hole has evaporated will be accessible from an 
observer who knows the dynamics of the black hole and has been collecting all off the Hawking radiation. 



4.1 Parallel circuit model on the complete graph 

Recall that in the parallel circuit model, a random maximum matching of the qubits is chosen and a random gate 
is applied on each edge of the matching. Consider figure [T] with the systems M and M' having a constant size m 
(think of M' as the message), and A and A' are in a maximally entangled state. Clearly, if we have access to the 
whole output we can recover the message, i.e., a purification of M. The following theorem proves that if we apply 
a parallel random circuit of depth 0(log n), a sufficiently large constant number of randomly chosen qubits of the 
output together with the system A are sufficient for approximately recovering the message. As mentioned earlier, 
this is equivalent to proving that the system M is decoupled from a subset of the qubits of size n — c for some 
constant c. 

Theorem 4.1. Let e > and mbea constant. In the setting described above, we have on average over a randomly chosen T 
of size n — cfor some sufficiently large c (depending on e and m) such that 



Pmt 



1 



< e 



with probability 1 — 0(log 3 n/ri) over the choice of the circuit. Here, pmt refers to the state you obtain by applying a random 
parallel circuit of depth O(logn). 

Proof We can write the initial state on M M' A 1 as 



P(0) 



2 2r, 



i>e{0,l,2,3}™ 



Then we have, as in the proof of Theorem 3.1 

1 



E- 



Pit) 



MT 



< E {tr[ov ® ct m ® tp(t)\ 2 } 

v£{0,l,2,3}™, / ue{0,l,2,3} T ,(l/,/i)/0 

E {tr[ov <g> a>p(t)] 2 } 



E 

i/e{0,l,2,3} m ,(i/,^)^0 



Y tr[ov ®o- v ® l/o(0)] 2 P {S t (supp(j/)) C T} 

i/e{0,l,2,3} m ,i^0 

= 0(P{S t ({l})CT}) 

where we defined the Markov chain {St} whose state space is the set of subsets [n] which corresponds to the set 
of non-zero Pauli operators. The transition probabilities of the Markov chain are defined as follows. We start by 
choosing a random maximum matching of the nodes. For each edge {i, j} of the matching, we do the following: 
if neither i nor j are in St, they are still not in but if one of the nodes {i,j} is in St, then with probability 

9/15, i and j are in St+i and with probability 3/15, i G St+i and j ^ St+i and with probability 3/15, j £ St+i 
and i £ St+%. As before, we use the notation St(A) when the Markov chain starts in the state A. Here our Markov 
chain is assumed to start in the state {1}, so we will drop the ({1}) from now on. 



Lemma 4.2. For a sufficiently large constant c and t > clog n and sufficiently small constant f, we have 

P{\S t \<fn}<0 



log 3 n 
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Before proving the lemma, we just note that it is sufficient to prove the desired result. In fact, for a randomly 
chosen T of size n — c, we have 



log 3 n 



P {S t C T} < P {Vx € [n] - T,x £ S t , \S t \ > fn} + P {\S t \ < fn} 
<P{x?S t ,\St\> fn} c + 

\ n 

where x is uniformly distributed on [n]. This proves the theorem. □ 



Proof [of Lemma 4.2 1 The analysis has two steps. The first part of the proof deals with the case where S = 0(log n) 
and the second part with the case S — O(log n). 

Define T\ = min{£ : \S t \ > 10 log n}. The pre-f actor 10 is chosen only for concreteness and can of course be 
chosen to be any constant and the statement remains unchanged. We start by proving that 

, ' loe 3 n 
P{Ti > Cl log7i} = 0' & 



n 

Let E be the event that for all s < c\ log n, nodes i, j € S s never get matched. We have 

P {Tx > ci log n} = P {Ti > ci log n, E} + P {T x > c x log n, E c } . (9) 
Let us analyze the second term first. For this, we denote the matching by {(M^, M^)} 1 < fc <„/ 2 - 

P{Ti > Cl logn,E c } =P{3s € [ci log n] , fc G [n/2] : M^,M| <E S* s ,T! > cilogn} 

ci log n 

< P{3ke[n/2]:Ml,MieS s ,S s <101ogn} 

8=1 

10 log 71- (10 log 71- 1) 

< ci logn — 

^ 100cilog 3 n 

71 

We now focus on the first term in |(9). Because E holds, we know that \S s+ i\ > \S S \ for all s e [c\ logn]. More 
precisely, if \S S \ = k, we have \S s+ i\ is distributed as k + Bin(fc, 9/15). But using a Chernoff-Hoeffding bound, we 
have 

P{Bin(fc,9/15) < fc/2} < e -^75 fe(3/5 - 1/2)2 < e' k/200 . 

We can now define the times T(i) = min{£ : \S t \ > 2 1 }. With this notation, and letting m = log(lOlogri), we have 
T\ = T{m). We can write 

P {Ti > ci logn, E} < P (T(l) > c'^™" 1 } + P (T(l) < c' 1 2 m " 1 ,T(2) > c' 1 (2" l_1 + 2™- 2 )} + 

+ P (T(l) + ••• + T(m - 1) < c' 1 (2™- 1 + . . . 2 1 ),T(n7,) > c' 1 (2 m " 1 + ■ • • + 1)} 

< e -l/200-c' 1 2 m - 1 + e -2/200-c' 1 2'"- 2 ^ y £ -2 m - 1 

= m ■ e- c ' 1 2m - 1 /20o_ 

where c[ is chosen so that c\ (2 m — 1) = ci log n. For ci (or equivalently c^) large enough, this expression is at most 
1/n. 

For the second part, we consider a large enough subset S C [n] and we prove that in one step of the random 
circuit, the size will increase by a constant fraction with high probability. Now it is not possible to assume that we 
do not have any gates within S itself. But the fact that S is large, we can have better concentration. First given an 
S, let Ns be the number of gates that are between two nodes of S. It is easy to see that the expected number of 
such gates is E {N s } — glMbijj . — l —. Actually what we want is to bound P {N s > f3\S\} where /3 is some small 
constant to be fixed later. We could use a straight Markov inequality 



p\S\ 2/3(n-l)' 
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which is good enough for \S\ = o(n) but does not give a good bound for linear \S\. That's why we compute the 
second moment of N s . 

E{Nl}= E{l W) l(*,o} 

i<j,k<l 

= E E l ll (^)}+ E E {i(«)iw)} 

i<j i<j,k<l,k,lg{i,j} 

= |S|(|S|-1) 1 |S|(|S|-1) (|S|-2)(|S|-3) 1 

2 n-1 2 2 (n-l)(n-3)' 

where t^j) is one if there is a gate applied between nodes i and j, which are both in S. Thus the variance is equal 
to 

W(NH Fl/vl 2 l-S-KI^I 1) 1 |S|(|S|-1) (|5|-2)(|5|-3) 1 |S| 2 (|£|-1) 2 1 
E{iV 5 }-E{7V s } = — + („_!)(„_ 3 ) 4 J^iy 

\S\(\S\-1) 1 / , (|S|-2)(|S|-3) 1 1 



2 n-1 \ 2 n- 3 2 n-1 

But - 2)(|5| - 3)(n- 1) = (|Sf - 5151 + 6)(n- 1) = (|5| 2 - \S\)(n - 1) - 2(2|S] - 3)(n- 1) and we compare that 
to (|Sf - \S\)(n-3) = {\S\ 2 - \S\)(n- 1) -2(|S'|(|5| - 1)). The first term is smaller than the second one provided 
| SI > 3 and |5| < n (which is the case). Thus we can bound the variance by the expected value: 

E{iV|} -V{N S } 2 <E{7V S }. 
By applying Chebyshev's inequality we have for any 7 > 0, 

P{N S > (l + 7 )E{7Vs}}< ' 



7 2 E{iVs}' 

Now if P is such that |S*| < 2^n, we define 7 so that (1 + 7) = /3|5|/E {N s } = 2/3 As a result, 

P{N s >f3\S\}< 1 



2(n- 1) 



W 2 -^0±~mS\(\S\-l) 

< 



\S\-1 

2(n- 1) 



(2/3(n-l)-(|5|-l)) 2 
1' 



= O 

provided for example |5| — 1 < /3(n — 1). 

We proved that we can assume that the number of gates within S is small. For the gates that associate a node in 
S with a node outside S, we need to prove that many of these gates lead to a Pauli operator of weight two so that 
we obtain an overall increase in the size of S. In fact, provided Ns < P\S\, the number of non-zero Pauli operator 
is distributed at least as (1 — fi)\S\ + Bin((l - 2/3) |5| ,3/5). Now we can bound using a standard Chernoff bound 

P { Bi„((l - 2/3)1.1, 3/5) < (/3 + 1/4) • \S\} < exp ( 5 ^ ~ 2 ^ ~ «> + 



i {1-20)\S\ 

( 5|5| (7/20 - (6/5 + l)/3) 
~ CXP 6 ' (1-2/3) 



2" 



For sufficiently small (3 and sufficiently large \S\ = 0(log n), this probability is 0(l/n). 

This proves that provided c log n < |5 S | < j3n for a sufficiently large c and sufficiently small /3, then we have 
I S s+ 1 1 > 5/4 • I S s I . Together with the first part of the proof, we obtain that after O (log n) steps of the random circuit 
we have \S t \> fin with probability 1 - 0(log 3 n/n). □ 
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4.2 Random circuit on a <i-dimensional lattice 



We now turn to examining the depth of a random quantum circuit restricted to nearest neighbours on a d- 
dimensional square lattice, required to scramble a constant number of initial low weight Pauli strings. As was 
shown in the previous section, this determines the depth at which we obtain entanglement assisted codes. 

We analyze scrambling in a model for which a partial parallelization has been performed of a sequential 
random quantum circuit on on a tf-dimensional lattice. By a d-dimensional sequential random quantum circuit 
we mean one for which a random two-qubit gate selected according to the Haar measure or uniformly from the 
Clifford group is applied to a pair of qubits selected uniformly from among nearest neighbors on a square d- 
dimensional lattice with open boundary conditions. The specific model consists of partitioning the lattice into 
coarse grained cells and in each time step performing a random two-qubit gate between a randomly selected pair 
of nearest neighbour within each cell. We consider two equivalent coarse grainings of the lattice into square cells 
of size 0(log n), such that the midpoints of the cells of the first set are the corners of the cells of the second set. We 
then have cells of type 1 corresponding to the first coarse graining and cells of type 2 corresponding to the second 
coarse graining. In alternating coarse time steps, gates are applied within each of the the cells of one set at a time. 
In each coarse time step a total of (3(log 2 n) gates will be performed. 

The following theorem proves that after coarse grained time steps, a sufficiently large constant 

number of randomly chosen qubits of the output together with the system A are sufficient for approximately 
recovering the message (see Figure [lj. As mentioned earlier, this is equivalent to proving that the system M is 
decoupled from a subset of the qubits of size n — c for some constant c. 

Theorem 4.3. Let e > and mbea constant. In the setting described above, we have on average over a randomly chosen T 
of size n — cfor some sufficiently large c (depending on e) such that 



1 1 

PUT -—^^ 



< € 

1 



with probability 1 — 0(1 /n) over the choice of the circuit. Here, p MT refers to the state you obtain by applying a random 
quantum circuit of depth 0{n 1 / d log 2 (n)) as described above. 



Proof As in the proof of Theorem 4.1 we only need to show that a Pauli string of weight one becomes a P auli 
string of linear weight within 0(n^ log n) time steps with high probability. We start by proving (in Theorem 4.4 
below) a lower bound of ( 1/n) on the gap of the second moment operator of a sequential random quantum circuit 
on n qubits with a <i-dimensional lattice interaction graph (or equivalently on the corresponding the Markov chain 
described in Section [272) . Then by a standard argument, one can obtain an upper bound on the mixing time of the 
Markov chain; see e.g., [MT06J. That is after t = 0(j^(n + log(l/<5))), the distribution on Pauli strings is (5-close 
to the the stationary distribution of the Markov chain which is the uniform distribution over all non-zero Pauli 
strings. 

We then apply this result to a cell which is a e?-dimensional lattice with O(logn) nodes. Then partition the 
cell into 2 d d-dimensional sub-cells with half the length of the original cell. Then, if we choose 6 to be inverse 
polynomial with a sufficiently large power, and applying 0(logn(logn + log(l/<5))) = 0(log 2 n) gates, a non-zero 
Pauli string in the cell gets mapped to a Pauli string whose support contains at least on element in each one of 
these sub-cells with probability 1 — 1/ poly(n). We can summarize this as follows: in each successful coarse time 
step every cell that contains a non-zero Pauli string gets mapped to a Pauli string that has support in each one of 
its sub-cells. By choosing the constants appropriately, we can make the probability of success of a coarse step to be 
1 - 1/ poly W- 

Consider now the following coarse time step that uses the alternate coarse graining. What the success of the 
previous coarse step is saying is that a cell with non-zero Pauli weight has contaminated all the cells of type 2 that 
overlap with it. By the same argument as in the previous paragraph, we see that in the coarse step involving cells 
of type 2, each one of these contaminated cells of type 2 will in turn contaminate the cells of type 1 that overlap 
with it. Thus, by repeating these alternate steps a number of times corresponding to the diameter of the graph of 

l/d 



cells O I ( J J , we reach a Pauli string of linear weight. □ 



Theorem 4.4. The spectral gap, A<j s , of the second-order moment operator for the d-dimensional sequential random quantum 
circuit described above is bounded from below by Ad s > ^for a constant a. 
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Proof The second-order moment operator of a sequential one-dimensional random quantum circuit is of the form, 



^ n— 1 

— j- 2J m «+i 



We will use the fact t hat the gap, Ai s , o f the second -order moment operator of a sequential ID random quantum 
circuit was shown in 1 Zni08 BCH+lij to be lower bounded by Ai s > -, to show a similar lower bound on the 
spectral gap, A q , of the second-order moment operator for a non-uniform sequential ID random quantum circuit, 
for which the probability of applying a gate to qubits i and i + 1 is with > 0. We next show how to write 
the second-order moment operator of the d-dimensional sequential random quantum circuit as a convex sum of 
such non-uniform ID sequential random quantum circuits, which we will lead to the desired bound by using the 
following lemma on the convexity of the spectral gap. 

Lemma 4.5. For two random quantum circuits whose gate distributions are universal and are invariant under Hermitian 
conjugation, with second-order moment operators Mi and M 2 with spectral gaps of Ai and A 2 respectively, the second-order 
moment operator describing any convex combination of the two random quantum circuits, M = p\Mi + p 2 M 2 , has a gap A 
that is lower bounded by A > p\ Ai + P2 A 2 . 

Proof We use the fact that every second-order moment operator of a random quantum circuit over a universal gate 
set has the same space of fixed points, V, onto which the second-order moment operator of the Haar measure, Mh aar , 
is the projector. Consequently, we may define the following operators M = M — M haar , M x = Mi — M haar , M 2 = 
M 2 — Mh aai which sets the eigenvalue of this eigenspace to 0. Now by the triangle inequality it follows that, 



\M\ 



-S p 



<Pi||Afi| 



Sp 



■p 2 \\M : 



2\\»i. 



where || || sp is the spectral norm. Since invariance under Hermitian conjugation of the gate distribution implies 
that the moment operators are Hermitian, it follows that A < piAi +P2A2, where A, Ai and A 2 are the subdominant 
eigenvalues M, M\ and M 2 , respectively. Since A = 1 — A, the lemma follows. □ 

The second-order moment operator for a non-uniform ID sequential random quantum circuit is given by, 



M„ 



^ n— 1 

— 1> 



+imu-\-i. 



Observe that because mu + i are positive semidefinite, we have 



M„ > min q. 



ii+l 



n—X 



This implies that the spectral gaps satisfy A q > mini g^+iAi 



ii+l- 

i=l 

mirij q ii+ i ■ f2(l/n) 



path I 



path 2 



Figure 2: A set of non-intersecting ID-paths on a 2D 4x4 square lattice 



The goal now is to write the second moment operator for the d-dimensional circuit as a convex combination 
of second moment operators for one-dimensional circuits. For this, we find a set of paths on the <i-dimensional 
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lattice such that each path includes every vertex and each edge is included in at least one path. Such a set may 
be constructed using d paths where the i-th path consists of every edge oriented in the i-th direction plus some 
perpendicular edges on the surface of the lattice. An illustration of such a set is given in Figure [2] for d = 2. For 
such a set of paths every internal edge is traversed by only one path, while an external edge may be traversed by 
as many as d paths. Thus, one may write the tf-dimensional sequential random quantum circuit as an average of 
d one-dimensional non-uniform sequential random quantum circuits where the pair with the lowest probability 
is X/dot that of the largest. Lemma 4.5 now implies that the gap, Ad s , of the tf-dimensional sequential random 
quantum circuit is bounded by Ad s > gAi s > - for a constant a. □ 



4.3 Lower bound on the scrambling time 

For a circuit of depth t consisting of gates, each of which act on at most fc-qubits, an initial Pauli operator of weight 
1 can only have support on a qubit distance kt away. Thus, on a d-dimensional lattice it may have support on 
at most (kt) d qubits, implying a depth of at least ^l{n}/ d ) for the weigh to be linear in n. For a random quantum 
circuit on the complete graph, the weight of a Pauli operator may increase by at most a factor of k in each time step, 
yielding an lower bound on the depth required for scrambling of fi(logn). Thus, the time at which most random 
quantum circuit scramble is within a constant or 0(log 2 n) factor of the fastest possible circuit on the complete 
graph and a tf-dimensional graph respectively. We think that the 0(log 2 n) factor in the case of the tf-dimensional 
lattice is an artifact of our proof technique. 



5 Outlook 

An interesting question is whether decoupling occurs in the general setting of | |DuplO} IDBWRlOl with random 
circuits of depth 0(poly(log n)). This would imply that random encoding circuits of O(poly(log n)) depth generate 
codes that are close to achieving the capacity of the erasure channel. 

Since the scrambling condition in tf-dimensional random quantum circuits utilizes a weak bound on the success 
probability of filling a sufficient number of cells, we think it may be possible to tighten our result to show strong 
scrambling, and thus stronger decoupling results for circuits of depth 0{n 1 / d \ogn) on tf-dimensional lattices. It 
would be interesting to see if the course graining technique employed here can be used to show that the depth at 
which random quantum circuits are e-approximate fc-designs also scales with the radius of the interaction graph 
as conjectured in [BHH12]. 

It is known that the unitary generated by an arbitrary local Hamiltonian at time, t, which is a polynomial 
in the size, n, of the system can be approximated by a circuit consisting of single and two-qubit gates whose 
depth is polynomial in t [P QSV11| [. Thus, whether our results imply that Hamiltonian evolution scrambles 
quickly depends on whether typical time independent Hamiltonians explore sufficiently uniformly the measure 
accessible to them at times sublinear in n. This question appears to be linked with the approach of random matrix 
theory | Sre94 , RDO08 1 to understand thermalization under dynamics generated by strongly-nonintegrable, time 
independent Hamiltonians, whereby the eigenstates of the Hamiltonian resemble those drawn uniformly from an 
appropriate matrix ensemble. It would be interesting to further explore the connection between quantum chaos, 
properties of random quantum circuits and quantum aspects of thermalization such as scrambling and decoupling. 
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A Analysis of the Markov chain 

Theorem A.l. Let X t (£) be the random variable representing the position of the random walk starting at £ after t steps. 
There is a constant csuch that for any f < 1/2 and t > cn log 2 n and all I e {1, . . . , n}, 

o/log3+h(/) 1 i 

Proof The general strategy of the proof is as follows. First, we pick a reference point r (which is going to be n/2) 
for which we can bound P {X t (r) < fn} easily. Then we will prove that for any I < r, starting at I, we will reach 
r within t steps with high probability. 

The stationary distribution of the chain is given by 7r(fc) = (see [HL09. Lemma 5.3]). As a result, we have 
for any t > 1, 

fn 



e=i v 7 i=i v 7 



< 

- 471 _ i 

2 (/log3+/i(/))n 

~ 4™ - 1 ' 

This allows us to bound the probability of the event [X t (n/2) < fn]. In fact, for any t, 

4»-l & n/2 

P {X t (n/2) < /„} = ( - )3n/g • V " 4 f_ 1 P {X t (n/2) < /n} (10) 

n 



< 



/ n \on/2 4 
\n/2) 6 4 ^ fci 

2 /log3+fc(/) 



Moreover, note that for ^ > n/2, we have 

P {X t (£) < fn} < max P {X s (n/2) < fn} 

l<s<t 

2 /log3+7i(/) 

- c; 2 )3-/ 2 

The remaining case is then £ < n/2. In this case, the objective is to show that 

2 /log3+h(/) 1 1 

p(*«m</»)< ^3^ + ^^. 

Define T = min{i > 1 : X t (£) > n/2}. Note that we have for any t 

P {X t (£) < fn} < P {T < t, X t {£) <fn} + P{T> t} 

= P {T < t, X t _ T (n/2) < fn} + P {T > t} 
< max P {X s (n/2) < fn} + P {T > t} . 

l<s<t 

Using (TO) , we can bound the first term. The objecti ye of the remainder of the proof is to bound the probability 
P {T > t} when t = cn log 2 n. This is done in Lemma A. 2 below. Once we have that, the result follows. □ 



Lemma A.2. For a large enough constant c, 

P{T> cn log 2 n} < 2" 2n 



2<(?) poly(n) - 
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Proof To prove this result, we start by defining an accelerated walk {Yi} as in |HL09] and the corresponding 
stopping time S = min{s : Y s > n/2}. More formally, let N = and N i+ i = minjfc > iVj : X^ ^ Xn { } and 
then Yi = X^j i . It is not hard to see that {Yi} is a Markov chain and the transition probabilities are given by the 
transition probabilities for {Xk} conditioned on moving. 

We also define the waiting time Wi = Ni+i — Ni — 1 to be the number of times the self -loop edge is taken. 
Conditioned on Yi, W% has a geometric distribution with parameter 2y '^~^~ 1 - ) . Notice that this distribution is 

stochastically dominated by a geometric distribution with parameter which we will use instead (we are only 
interested in upper bounds on the waiting times). 

Getting back to T, notice that T = S + W x + W 2 H h W s . So we have for all s 

P {T > t + s} < P {S > s} + P {S < s, Wi + ■ ■ ■ + W s > t} . (11) 
We will choose s later so that both terms are small. 
Lemma A.3. For any s > 2n, we have 

P{S > s} < exp(-s/8) . 

Proof For this we just use a concentration bound on the position of a random walk relative to its expectation. 
First we define a random walk Y( with Yq = and it moves to the right with probability 3/4 and to the left with 
probability 1/4. Observe that the probability of moving right is at most 3/4 for Yi provided Yi < n/2. For this 
reason, before S, we can assume that Y( < Yi. In other words, we have S' > S where 5" = min{i : Y( > n/2}. 
Thus, 

P {S > s} < P {S" > s} 

<P{Y s '<n/2} 

= P {y s ' < l + s/2 - (s/2 + £- n/2)} 

, (s/2- 
< exp ' 



Y2 



2s 

< exp(-s/8) 

where we used the fact that E {F s '} = £ + s/2 and a Chernoff-type bound, see for example [HL09, Lemma A.4]. □ 

We now move to the second step of the proof where we analyze the waiting times W\ -\ h Ws- Recall this is 

the total waiting time before the node r = n/2 is reached. 

Lemma A.4. We have 

P {S < s,W! + ■■ ■ + W S > cn\og 2 n} < ' ' 



2<(7) poly(rc) 

Proof The techniques we use are similar to the techniques in [HL09J, but we need to improve the analysis in 
several places. We try to use similar notation as [HL09J as much as possible. 

As in the proof of [HL09 . Lemma A.ll], we start by defining the good event 



x=l Lfc=l 



' S 



t{Y k <x)< jx/n 



where \i = l/2j^]The parameter 7 is going to be chosen later. This event is saying that states with small labels are 
not visited too many times. Later in the proof, we will show that the P {H c } is small. Define the random variable 



: We use this notation to apply |HL09 Lemma A.5] later, fi corresponds to the probability of going forward minus the probability of going 
backward for a simplified walk that moves forward at most as fast as Yj. . In our case, we have fj, = 1/2 because we stop after reaching state 
r = n/2, and the probability of moving forward at n/ 2 is 3/4. 
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M = mini<i<5 Yi. We have 

i 

P {Wi + ... Ws > t,S < s,H} = ^ P {M = m,S <s,Wi + ... Ws > t, H} 

m=l 

e 

= ^2P{M = m}P{S<s,Wi + ...W s >t, H|M = m} 



rri—1 



J2P{M<m} max P {W( Vl ) + ■ ■ ■ + W(y s ) > t} , 

* — . \Ui\ satisfying M—rn and H and S<s 



< 

m— 1 

(12) 



where the maximum is taken over all sequences yi, . . . , y s of possible walks and W(y) is the waiting time at state 



B.l 



We will bound P {M < to} using Lemma B.l Our random walk starts at position £ so that, in the notation of 
Lemma 



V- = 6<(n-<)+2<(<-l) fOT k - 1 + l ' P + = 6fc(n-fc)"+2(<+l)< - As a IeSult ' We haVe 



_ 6£(n - 1) _ n-l 
a - ~ 2l{l-\) ~ 1^1' 

As we stop after reaching the reference point r = n/2, we can bound p + > 3/4. As a result, we have 

1 

1 + 3-^(1-1/3) 



P{M<£-1}< 1 n _ t 



I _i_ 9 • '0=1 

1 £-1 

< 



2 n-£ 

Reaching £ — 2 before r means reaching £ — 1 before r starting at £ and reaching £ — 2 before r starting at £ — 1, and 
these parts of the walk are independent. As a result, by induction, we can then see that 

™r,, ! 1 (^-l)(£-2)---m 
P {M < to} < 



2 <-m ( n _£}( n _£ + 1) . . . (n - to - 1) 
1 £! 2 m u(n - 1) • (n - m) 

~ 2 1 ' n(n-l)---(n-£+l) ' £(n - £) (to - 1)! 

< ^ • (a»r. d3) 

We now look at the term maX|y i } satisfying M=m and H and 5<s P {W (yi) H + W(j/s) > *}• As argued in the proof 

of IIHL091 Lemma A. 11], the maximum is achieved when we make the walk visit as many times as possible the 
states with smaller labels. This means state m is visited jm/fi times, and all i > m are visited 7//1 times. So we 
can write 

7m//i n/2 

W( yi ) + --- + W(y s ) < Gm,i+i2 E (! > - 

i=l i—l k— m+1 

where Gk,i has a geometric distribution with parameter 2k/5n and the random variables {Gk,i} are independent. 
We are going to give upper tail bounds on the right hand side by computing the moment generating function. For 
any A > 0, we have, using the moment generating function of a geometric distribution and the independence of 
the random variables: 

r./ (J^'r, ^ V? r, \\\ I 2">A" V"" 2 rf I 2 */ 5 » V" 
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Now take A so that e x = ^ v . This leads to 

1— m/ (on) 

/W^ 7/M n/2 \ \ "I . . 7m/Al n/2 7 / M 

■HME^IE«m - ^ ■ n ^ 

i=l i=l k=m+l J J I v 7 fe=rra+l V 

. fc— m+l 



7/M 



As a result, using Markov's inequality, we obtain 



{■ym/fj, 7/ ft n/2 "| f / /7m /ft 7/ft n/2 \\ 

X) G mil + ^ X] Gfc .* > O = P < exp A 2 G ro>i + X X G M > e 
i=l i=l fc=m+l J I V V i=1 i=1 fe=m + 1 / / 

< 2 7m/M e 7m/(2M)-lnn . ^ _ m / 5n )t 

^ 2~frn/ [i^ym/ (2[i)-\nn _ g— tm/(5n) 

Getting back to equation | (12) , we have 

1 ' 

P {^i + . . . W 5 > i, S < s, H} < — — (2n) m 2' im ^e' rm/{2 ^ lnn ■ e - tm/(5n) 

2 \t) rn=l 



2 ^(") ro =l 



Thus, for t > cn log 2 n with sufficiently large c, this probability is bounded by O 
It now remains to bound P {H c , S < s}. Fix x <G {!,..., n}, we have 



(f ) poly(n) 



P < x) > lx/n,S< s \ < J2 P \ Y i = x ' t Vz < i> Yi > x l >i < S >Y 1( - Yk ^ *) > Wa* 

U=i J i=i I fc=i > 

<J2 P \ Y i = x >W i <3,Yi>x],3<S, HYk<x)>^x/(i 
.1 1 [ fc=i+i 

r ^ 

<^P{M<a;}-P< MYk<x)>^x/n\Y j =x,j <S 

j=i [k=j+i 

where we defined Sj = min{s > j + 1 : Yfc > n/2}. To obtain the last inequality, we simply used the fact that 
[Yj ■ = x, j < S] C [M < a;]. Moreover, [j < S] can be determined by looking at Yi, . . . , Yj and thus conditioned on 
[Yj = x], Yj. for k > j + 1 and also Sj are independent of [j < S]. This means that we can drop [j < S] from the 
conditioning. 

To bound P {M < x}, we use ( |13[ |. We can also bound Y^ by a simpler random walk Y£ that moves forward 
with probability 3/4, as we did in the proof of Lemma A.3 Thus, we obtain 

1 , . „ / u(7 — 2)x 
< 2 ^ y (2nr. S .2exp(- / ^- 



21 



where we used [HL09, Lemma A. 5]. As a result, by a union bound, 

P {H c , S < s} < -i- • 2s ■ J2 exp ( x (log(2n) - ^— ^ 



< 



1 

poly n ' 



where to get the last inequality, we choose j = d log n for large enough d and use the fact that s will be chosen 
linear in n. Continuing, we reach 

P {W l + . . . W s > t, S < s} < P {W l + . . . W s > t, S < s, H} + P {H c , S<s} 

1 1 

< 



V " poly(n) 



□ 



To complete the proof of Lemma A. 2 we just plug the bounds obtained from Lemma A.3 with s = I6n and 
from Lemma A.4 into equation (IT) . □ 



B An additional lemma 

Consider a random walk on a line indexed from — 1 to a. At positions i > 0, the probability of moving to the right 
is p+(i) (depending on i and for points i < 0, the probability of moving to the right is p_. The following lemma 
gives a bound on the probability of hitting the node —1 before hitting a when starting at position 0. In our setting, 
we are interested in the case where p_ and p + are (significantly) larger than 1/2 so that the probability of hitting 
— 1 before a is small. 

Lemma B.l. Assume p + (i),p_ > 1/2. Then the probability of hitting —1 before a is exactly 

1 



where a + (i) = and a_ = ^ p . In particular, if a+(i) = a + for all i, this probability becomes 



1 1 

r < 



1 + a_ • 



°+-»; ' 1 + a- ■ (1 - l/a+) 



Proof Let Pi be the probability of first reaching — 1 when starting at position i. We can write for any for i 6 [1,(1—1], 
Pi = p + (i)Pi + i + (1 — p+(i))Pi-x, which can be re-written as 

/,+ ( " (P i -P i+ i) = (P < _ 1 -P i ). 



p + (a-l) 



We now use the boundary condition at node a: P a = 0. Thus, {P a -2 — P«-i) = x f ^ ( ct _ 1 ) Pa-i- Moreover, we see 

a- 1 g+jj) N 
j=i l- p+ {j) 



by induction that for any i > 1, Pj_i — P, = ( Jl^i 1 ) Pa-i- We can now write a telescoping sum 



p - p„_i = 53-^-1 - -p< = £ n ■ p »-i- 

2—1 2—1 j=2 

As a result, 

(a— 1 a — 1 
»=i j=i 
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We can then write P_i - P = (P - Pi) = P a _i • ' T^r- 

Now, we use our second boundary condition P_i = 1. We have 

o-l 

1 = P-i = Po + Pa-i ■ a- I] 

n^i 1 a +u) 



= P 1 + a_ 



A .7= 

which leads to the desired result. □ 
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